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Abstract 

In Monoidal Computer I, we introduced a categori- 
cal model of computation where the formal reasoning 
about computability was supported by the simple and 
popular diagrammatic language of string diagrams. 
In the present paper, we refine and extend that model 
of computation to support a formal complexity theory 
as well. This formalization brings to the foreground 
the concept of normal complexity measures, which 
allow decompositions akin to Kleene ’s normal form. 
Such measures turn out to be just those where eval- 
uating the complexity of a program does not require 
substantially more resources than evaluating the pro- 
gram itself. The usual time and space complexity are 
thus normal measures, whereas the average and the 
randomized complexity measures are not. While the 
measures that are not normal provide important design 
time information about algorithms, and for theoretical 
analyses, normal measures can also be used at run 
time, as practical tools of computation, e.g. to set the 
bounds for hypothesis testing, inductive inference and 
algorithmic learning. 

Index Terms 

categorical models and logics, foundations of com- 
putability, logical aspects of computational complexity, 
semantics of computation 

1. Introduction 

Motivation. This is an old fashioned paper, inspired 
by Blum’s "Machine Independent Complexity Theory" 
Levin’s and Meyer’s work on the "Fundamental 
Theorem of Complexity” [23], [251, and a host of such 
papers — mostly from the 1970s. Why is it worthwhile 
to go back to that work, when theoretical computer 
science went in a different direction? 


Why is it reasonable that theoretical computer sci- 
ence still works with tapes, and still programs its 
abstract machines in low level machine languages, long 
after the real computers stopped using tapes, and when 
the real programmers only use machine languages to 
program firmware? There are surely some reasonable 
and convincing answers to this question, and there are 
probably some good reasons why the theoreticians like 
to use low level models. But as theoretical computer 
science is becoming more and more practical, the 
practical tasks are emerging where high level models 
and machine independent reasoning and programming 
are becoming necessary. One such task [29] led me 
on the path towards monoidal computer. The task was 
to measure the hardness of deriving an attack algo- 
rithm on a given system with known vulnerabilities. 
This task is easily formalized, but requires measuring 
the complexity of algorithm transformations. There 
are high level programming languages convenient for 
programming program transformations, but there are 
no research tools for studying the complexity of such 
programs. Wondering why, I turned to a tool that 
seemed useful for understanding high level program- 
ming languages: category theory. 

So my defense for the strange and demanding 
concoction of the formalisms that I offer here is 
very ambitious: I am hoping that it will get us a 
step closer to a high level language for reasoning 
about computability, complexity and cryptography, by 
reusing some ideas and structures that evolved in such 
languages for reasoning about software, systems, and 
even about quantum computing. If this turns out to be 
a completely wrong direction, then we shall at least 
gain some insight why the problem of complexity is 
so different from pretty much everything else. 

Idea. Intuitively, computation is often viewed as a 
straightforward process. A computer is given a pro- 
gram F, and it is set into a configuration (q, a). 


where q is the initial state, and a are the input data. 
The computer then searches for an instruction of the 
program F that is enabled by the configuration (q,a), 
and if it finds such an instruction, it executes it, thereby 
changing the state to q-\ and the data to a \ . Then it 
searches for an instruction enabled by the configuration 
(< 7 i,ai), which leads to a configuration ( 52 , 02 ), and 
so on. The computer thus builds an execution trace, 
which can be viewed as an expression in the form 

F : ( q , a) — > (qi, a\) (qi, at) — > ■ • • (1) 

If the trace reaches a configuration ( q n ,a n ) where no 
instructions of the program F are enabled, then the 
computation terminates. The output of the computation 
can then be found among the data a n , say as the part 
that is stored on a designated output tape. 

Kleene’s Normal Form Theorem fl9 | formalizes this 
view of computation mathematically. It says that every 
computable function / : A — »• B, implemented by 
some program F, can be reduced to the normal form 

f(a) = w(fix. T(F,a,x)) (2) 

where w : N — » N and X 1 : N 3 — >• {0,1} are 
some primitive recursive functions, explained below, 
and px : {0, 1} N — »• N is the search operator. What 
does (0 mean? The idea is that any execution trace (IT}, 
as soon as it is finite, and thus denotes a terminating 
computation, can be encoded by a unique natural 
number x. Kleene constructed a primitive recursive 
predicate T(F,a,x) that tests whether x encodes the 
trace (JTJ of an execution of the program F on data a. If 
the search px.T(F , a, x) finds such a trace x, then the 
primitive recursive function w extracts from its final 
configuration the output of the computation of F on 
a. Formula 0 thus tells that every computation can 
be reduced to a single search px, precomposed with 
a primitive recursive predicate T(F,a,x) which tests 
that x is the trace of the program F on the input a, 
and postcomposed with a primitive recursive function 
w which extracts the outputs from the traces. 

Note, however, that besides the program, the input 
and the output, the trace 0 also carries the information 
how many steps did the computation take, and what 
was the largest memory area that it occupied. So if we 
replace the primitive recursive function w with some 
other functions, we can compute the time and the space 
complexity. That is the idea that we pursue in this 
paper. It arises from the observation that the suitable 
encodings of execution traces are not only complexity 
measures themselves, but that they are universal among 
a natural family of complexity measures, which we call 
normal. We present them as a categorical structure, and 
calculate with them using string diagrams. 


Outline of the paper. In Sec. 01 we spell out the 
minimal preliminaries that fit in this paper. In Sec. 0 
we review the structure of monoidal computer. Sec. [4] 
introduces the structure of graded monoidal computer. 
The grades implement the execution traces categor- 
ically. In Sec. [5j we spell out the normalization in 
graded monoidal computer. In Sec. [6] we define and 
characterize normal complexity measures. 

Related work. While computability and complexity 
theorists seldom felt a need to learn about categories, 
there is a rich tradition of categorical research in 
computability theory, starting from one of the founders 
of category theory and his students m. Esi, through 
the extensive categorical investigations of realizability 
na, a, ma, to the recent work on Turing categories 
0, and on a monoidal structure of Turing machines 
l3l . This recent work has, of course, interesting cor- 
relations with basic monoidal computer, but also sub- 
stantial differences, arising from the different goals. 
The closest in spirit to the present work seems (2}, also 
drawing its structural content from abstract complexity 
theory. 

2. Preliminaries 

A monoidal computer will be a symmetric monoidal 
category, with some additional structure. As a matter of 
convenience, and with no loss of generality, we assume 
that it is a strict monoidal category. The reader familiar 
with these concepts may wish to skip to the next 
section. For the casual reader unfamiliar with these 
concepts, we attempt to provide enough intuitions to 
understand the presented ideas. The reader interested 
to learn more about monoidal categories should consult 
one of many textbooks, e.g. El, DSI. 

Monoidal categories. Intuitively, a monoidal category 
is a category C together with a functorial monoid 
structure 

CxC^C^l 

When C is a monoidal computer, then we think of 
its objects G |C| as datatypes, and of its 

morphisms, /, g... G C(A,B) as computations. The 
tensor product A <g) P B <g> Q then captures 

f 

the parallel composition of the computations A — » B 
and P A- Q, whereas the categorical composition 
A C is the sequential composition of A — > /i 
and B A- C. 

With no loss of generality, we assume that the 
tensors are strictly associative and unitary, and thus 


treat the objects A ® {B ® C) and (A® B) ®C as the 
same, and do not distinguish A® I and I® A from A. 
This allows us to elide many parentheses and natural 
coherences lfl7l . (24l Sec. VII.2], Note, however, that 
the isomorphisms A®B ^4 B®A cannot be eliminated 
without causing a degeneracy. 

Notations. When no confusion seems likely, we write 

• AB instead of A® B 

• C(X) instead of C(/, X) 

String diagrams. A salient feature of monoidal cat- 
egories is that the algebraic laws of the monoidal 
structure correspond precisely and conveniently to the 
geometric laws of string diagrams , formalized in na, 
but going back to (34) ■ See also (38l for survey. A 
string diagram usually consists of polygons or cir- 
cles linked by strings. In a monoidal computer, the 
polygons represent computations, whereas the strings 
represent data types, or the channels through which 
the data of the corresponding types flow. String dia- 
grams thus display the data flows throught composite 
computations. The reason why string diagrams are 
convenient for this is that the two program opera- 
tions that usually generate data flows, the sequential 
composition / ; g and the parallel composition / ® t, 
precisely correspond to the two geometric operations 
that generate string diagrams: one is the operation of 
connecting the polygons A 4 B and B 4 C by 
the string B, whereas the other one puts the polygons 
A 4 B and P 4 Q next to each other without 
connecting them. The associativity of these geomet- 
ric operations then imposes the associativity law on 
the corresponding operations on computations. The 
identity morphism id. 4 , as the unit of the sequential 
composition, can be viewed as the channel of type 
A, and can thus be presented as the string A itself, 
or as an ’’invisible polygon” freely moved along the 
string A. The unit type I can be similarly presented 
as an ’’invisible string”, freely added and removed to 
string diagrams. The algebraic laws of the monoidal 
structure are thus captured by the geometric properties 
of the string diagrams. The string crossings correspond 
to the symmetries A ® B -4> B ® A. 

Data services. We call data service the monoidal 
structure that allows passing the data around. In com- 
puter programs and in mathematical formulas, the data 
are usually passed around using variables. They allow 
copying and propagating the data values where they 
are needed, or deleting them when they are not needed. 
The basic features of a variable are thus that it can be 


freely copied or deleted. The basic data services over 
a type A in a monoidal category C are 

• the copying operation A 4 A ® A, and 
> the deleting operation A 4 /, 

which together form a comonoid, i.e. satisfy the equa- 
tions 

5 ; (S ® A) = 6 ; (A <g> 6) (3) 

6 ; (t 0 A) = 5 ; (A <g> t) = fcU (4) 

V4' 

The correspondence between the variables and the 
comonoids was formalized and explained in l27l . lUfl . 
The associativity and the unit of the copying operation 
allow defining the unique n-ary copying operations 
A 4 A®", for all n > 0. The tensor products 0 in 
C are the cartesian products x if and only if every A 
in C carries a canonical comonoid A x A 4 A 4 1, 
where 1 is the final object of C, and all morphisms 
of C are comonoid homomorphisms, or equivalently, 
the families A 4 A x A and A 4- 1 are natural. 
Cartesian categories are thus just the categories with 
natural copying and deleting operations. 

But besides copying and deleting, we often also need 
a third data service: 

• the comparison operation A ® A -4 A 

which is required to be associative, in the sense dual 
to ( 0 ), and thus makes A into a semigroup. Its asso- 
ciativity allows defining the unique n-ary comparisons 
A® n 4 A, for n > 1. The copying and the comparison 
operations are further required to satisfy the data 
distribution (or Frobenius M 8 l l conditions 


(8 ® A) ; ( A 0 q) = q ; 8 = (A <g> 8) ; (q <g> A) 8 ; q = id 



These conditions allow factoring any morphism 
A® m A®” generated by 6 and q into the spider 
form A® m 4 A 4 A®". In summary. 

Definition 2.1: A data sendee over an object A of 
a monoidal category C consists of 

• the copying operation A 4 A ® A, 

> the deleting operation A 4 I, and 

• the comparison operation A ® A 4 A 


such that 

« S and g are associative, 

• T is the unit of S, 

m S and g satisfy the data distribution conditions. 

Examples and non-examples of data services. Non- 
trivial cartesian categories do not support comparisons. 
However, the cartesian structures A x A 4 - A -!-» 1 
from the category Set of sets and functions also live 
in the monoidal categories Rel of sets and relations 
and Pfn of sets and partial functions. These categories 
are not cartesian because the singleton maps are only 
natural with respect to the total relations, whereas the 
diagonals are only natural with respect to the single- 
valued relations (i.e. partial functions). Both Rel and 
Pfn allow comparisons: a comparison A x A 4 A 
is the converse of the diagonal, i.e. g( x,x) = x, and 
q(x, y ) remains undefined if x ^ y. So the cartesian 
structure of Set provides the standard data services 
in Rel and Pfn. In addition, Rel also admits many 
nonstandard data services, that do not come from the 
cartesian structure. This was analyzed in E3, ED- 
Indeed, a Any abelian group (or groupoid) structure 
A x A -i* A can be used as the comparison operation, 
with the corresponding copying operation A A A x A 
relating each x € A with all pairs (y,z) £ Ax A such 
that x = y + z. The deletion operation A — > t relates 
the unit of the group A with the only element of 1. 

Functions. A morphism / G C(A. li) is called func- 
tion if it is a comonoid homomorphism with respect 
to the data services on A and B , i.e. if it satisfies the 
following equations 

f;$B = S A -,(f®f) f-,r B = T A (5) 



If C is the category of relations, then the first equation 
says that / is a single-valued relation, whereas the 
second equation says that it is total. Hence the name. 

Notation. Assuming that C is given with a chosen 
data service on every objects, we denote by & the 
category of functions in C. 

Note that the morphisms S and T from the data 
services are functions with respect to the induced data 
services. They are thus contained in C\ and they are 
natural with respect to the functions. It follows that & 
is a cartesian category. 


3. Monoidal computer 
3.1. Background and definition 

From ED to [j20j, the structure of cartesian closed 
categories has been the foundation of categorical logic 
and type theory. It is based on the correspondence: 

C(X,B a ) = C(XxA,B) (6) 

between the functions X x A - ’ 'y /j on the right 
hand side, and their abstractions X Xa ^ x,a } > jgA on 
the left. In a practice-oriented semantics of compu- 
tation, the A-abstraction could be used to represent 
programming, as an operation mapping the specifi- 
cations of the computable functions on the right to 
the programs on the left. The program evaluation, 
as an operation mapping the programs to computable 
functions, would then be represented by the appli- 
cation, i.e. the transition from left to right in ©. 
But since the correspondence in © is bijective, these 
transitions don’t just evaluate each program into a 
unique computable function, but also assign a unique 
program to each computable function. In reality, of 
course, there are always infinitely many different pro- 
grams that compute the same function, as soon as the 
programming language can express enough arithmetic. 
The extensional models of computation, underlying 
©, can be interpreted as viewing the computer as 
a black box, where only the inputs and the outputs 
are observable, and any two programs that map the 
same inputs to the same outputs are indistinguishable. 
Such view has been not only the tenet of the theory of 
denotational semantics |37|. [39j, but also the stepping 
stone into the practice of functional programming BSD- 

The intensional view of computation can also be 
presented categorically in many ways na, m. @, 
as mentioned in the Introduction. One obvious way 
to allow multiple programs for the same computable 
function is to relax the bijection in ([6]» to a surjection. 
This surjection is the main structural component of 
monoidal computer. After some fine tuning, it takes 
the form 

AB 

C*(X, P) C(X (g) A, B) (7) 

F 

where the program enumerations X P on the left 
are mapped to the computations X (g> A jg 

on the right. Here the Kleene bracket {— } executes 
the program F x and yields the computable function 
/ = {-Flu} : A — »• B, which can be applied to all 
data a of type A. To understand the step from ([6]i to 
©, consider the category Pfn of partial computable 


functions between the finite powers of the set of natural 
numbers D\l, with 1 = N°. Since Pfn(X, 1) = pX, 
there is no terminal object, thus no cartesian structure. 
That is why cartesian products x from © are relaxed 
to the tensor products <8> in ©. To be able to copy and 
to delete the data, we must specify the data services 
explicitly. Note that this does not just recover the 
cartesian structure without the naturality requirement, 
as there are generally many nonstandard data services, 
already in the categories as standard as Rel l28l . While 
the partiality can be modeled within the cartesian 
structure |26l , ||9| , going beyond the standard model 
of computation, and modeling the randomized and 
quantum computers, does seem to genuinely require 
nonstandard data services fTOl , l30l . ITil . On the other 
hand, the program enumerations and transformations 
on the left hand side of © are required to be total 
and single valued; hence the restriction to & (denoted 
C c in COl). Anticipating that the computations will be 
typed, but that all programs as data will be of the same 
type, we also replace the exponent B A in © by the 
type P of programs in ©. These intuitions motivate 
the formal definition of monoidal computer. 

Definition 3.1: A monoidal computer is a strict 
symmetric monoidal category C with the following 
structure for all objects A and B in C 
Q i - 

(I) a data service AA A —> I 
s 

(II) a distinguished object of programs P and a fam- 

AB 

ily C\X,P) x ■- >> C(XA,B ) of surjections 
natural in X. 


3.2. Universal and partial evaluators 


The families of surjections © turn out to be just 
a categorical version of the acceptable enumerations 
of computable functions ED, where the enumeration 
indices represent the programs. 

Proposition 3.2: Let C be a symmetric monoidal 
category with data services. Then specifying the sur- 
jections : C\X, P) -» C(XA,B) that make C 
into a monoidal computer is equivalent to giving for 
all objects A and B in C 

(a) universal evaluators u AB £ C(PA,B) such that 
for every / £ C(A, B) there is F £ C^P) (which 
we call a program for /) such that 


B B 



( 8 ) 


(b) partial evaluators s( AB ^ c £ C^(P A, P) such that 



Proposition 3.3: Every type A in a monoidal com- 
puter is a retract of P: there are computations i A £ 
C(A, P) and v A £ C(P,A), such that the composite 

l a v a 

A — > P — H A is the identity. These retractions are 
isomorphisms if and only if the family of surjections is 
natural in A or in B. Monoidal computer then provides 
a model of untyped A-calculus. 

Remark. In |[32l we only considered the basic 
monoidal computer, where all types were the powers of 
P. In the standard model, the programs are encoded as 
natural numbers, and all data are the tuples of natural 
numbers. Prop. 13.31 implies that all types must also be 
recursively enumerable in the internal sense of C. In 
particular, by extending the A-calculus constructions 
used in l32l . we can extract from P the convenient 
types of natural numbers, truth values, etc. Here we 
only need the booleans. Deriving the boolean opera- 
tions from the structure of the monoidal computer is 
an instructive exercise. 

Definition 3.4: A predicate in a monoidal computer 
C is a computation a £ C, ( A . 2), where the type 2 of 
booleans is a type where C^(2) = {0, 1}. 


3.3. Examples of monoidal computer 

The standard model of monoidal computer is the cat- 
egory of partial computable functions over the tuples 
of natural numbers. The programs are also encoded as 
natural numbers, and thus P = N. The objects can be 
just the powers of N, but also all of their recursively 
enumerable subsets. The universal evaluators can be 
the computations implemented by a fixed family of 
universal Turing Machines. The partial evaluators are 
the total recursive functions constructed in Kleene’s 
s-m-n-Lemma Extending this model to recur- 

sive relations and nondeterministic Turing machines 
leads to minor changes of the evaluation structure, 
but introduces many nonstandard data services l28l . 
which can be used to encode nonstandard algorithms 
GO- A quantum monoidal computer can be defined 
within the category of complex Hilbert spaces, with 
all linear maps as morphisms. The data services are 
provided by Frobenius algebras □ 3 ). The category 
of functions with respect to these data services is 
equivalent with the category of sets and functions flOl . 


so the encoding of programs will be classical, and 
the same as in the standard monoidal computer. The 
universal and the partial evaluators can be defined as in 
E). It is important to note, however, that the program 
evaluations 7 AB are not surjective in a set-theoretic 
sense, but dense for the topological sense spelled out 
in El- Lastly, let us mention that any reflexive domain 
EH gives rise to an extensional monoidal computer, 
which embodies both (O and Q. For more detail see 
[32J Sec. 4.1]. 

4. Graded monoidal computer 
4.1. Graded categories 

While categories are very convenient for denota- 
tional semantics, capturing computation as a process 
requires some additional structure Cl, ED, G2- Cap- 
turing the complexity of computations requires a quan- 
tifiable view of that process, to allow us to count the 
steps, measure the memory, etc. If the morphisms of 
a monoidal computer represent computations, then we 
need to introduce some structure over these morphisms 
to express how much of a computational resource each 
of them uses. One idea is to consider the subsets 
C„(A,.B) C C(A,B) that consist of those computa- 
tions that use at most n units of a given resource: e.g., 
at most n steps in time, or n cells of space. Since the 
composite programs p ; q and p <8> q may need up to 
m © n units of the resource, if p needs to units, and 
q needs n, then the scale in which the resource will 
be measured must carry at least the structure of an 
additive monoid. 

Grading monoids. Let (AI,®,0, 00) be a commuta- 
tive monoid with the absorptive element 00, i.e. such 
that 00 © to = 00 for all m £ Ai. The relation 

m<n <=> 3l.t®m = n (10) 

is obviously transitive and reflexive, i.e. a preorder. 
The equivalence classes with respect to the relation 
to ~ n -£=>■ to < n A to > n are also the factors 
of the subgroup Q = {m £ Ai \ 3n. m@n = 0}. For 
simplicity, we assume Q = { 0 }, i.e. begin by factoring 
Ai modulo This not only makes < into a partial 
order, but when Ai is finitely generated, then (Ad ,<) 
is also a well founded lattice. For more see l36l . 

Examples of grading monoids. The additive monoid 
of natural numbers completed at the top N = NU{oo} 
is the free grading monoid over one generator. On the 
other hand, the monoid of multisets of well-formed ex- 
pressions in any given language, extended by 00 again. 


can also be used as a grading monoid. In-between these 
extremes are the grading monoids normally used in 

, . , , . t-tN / 1 t-tN / ^ 

complexity theory: the quotients Dn / = and N / = 

— N — 

of the monoid N of functions from N to N, identified 
modulo the equivalence relations 

f = g f<g/\f>g 

o 00 

f=g / <sa / >g 


where 

f<g 3cflx. f{x) <c + g(x) 

o 

f < g <=>■ 3cd flx > d. f(x) < cg(x) 


Definition 4.1: A category C is Ai -graded if every 
hom-set C(A,B) comes with 

(i) grading C(A,B ) — — ^ Ai, which induces the 
graded hom-sets 

C n (A,B) = {f gC(A,B) I ll/ll <n} (11) 


the elements of which we write as / n ; 

(ii) restriction |" n : C(A 1 B) — > C n (A 1 B) for every 
n£W where for all f m £ C m (A,B) holds 

= fmt\n (12) 


We require that identity morphisms are of grade 0, and 

\\f;g\\ < ll/ll ©llffll (13) 

which makes the following diagram commute 

Ct(A, B) x C n (B, C mn (A, C) 


idx |-„ 


(;) 


(14) 


C t (A, B) x C m (B, C ) -JS|§ C) 


An Ai- graded monoidal category is a monoidal cat- 
egory C, which is AI -graded in the above sense, with 
all monoidal isomorphisms (such as A <g> B A- B © A) 
of grade 0 , and moreover 

ll/®*ll < ll/ll ©Pll (15) 

making the following diagram commute 


C e (A,B)xC n (P,Q) 

L X t m 

C k (A,B) x C m (P, Q) 


Cf.®n(AP, BQ ) 


\ fc®r? 


Ck®m(AP, BQ) 


(16) 


Remark. Note that we do not impose any require- 
ments on the grading map C(A,B) — — ^ A4 that 
would allow lifting the lattice structure from A4 to 
C(A,B), and in general \/{n < oo} = oo does 


not imply that [j n<oc C n (A, B) covers C 00 (A 1 B) = 
C(A,B). It usually does not. 

Definition 4.2: We say that a computation I A- A 
halts if there is m < oo such that a = a\ m . More 

f 

generally, we say that A — > B halts if the composite 
I —y A A B halts whenever a halts. The subcategory 
of total functions that halt is denoted C^, and thus 

C*(A,B) = U Cl (A,B) 

m< oo 

Definition 4.3: We say that a predicate A A- 2 is 
decidable if it always halts and moreover outputs a 
single value, i.e. a £ C^. 

4.2. Definition and characterization 


Definition 4.4: An Ad-graded monoidal category C 
with data services in Cq is an Ml- graded monoidal 
computer if it carries the following structure for all 
A,B £C: 

, AB 

(I) a family Cq(X, P) - x - > C(XA,B) of surjec- 
tions natural in X, 

(II) families cr£, r£ and i)l, all natural in X , such 
that the following diagrams commute 


c\{x, p) 7<r )c 


$(XA, P) 



C(XAB, C) 


c5(x,p) 7 r 


C(XA, P) Ka 


C(XA, B) 


C n (XA, B) 


C n (XA, P) K A n 


Proposition 4.5: Let C be an Ml -graded monoidal 
category with data services. Then specifying the 
structure of an Ad -graded monoidal computer as in 
Def. I4.4H -II) is equivalent to giving for all A, B £ C 
and all n £ Ad 

(a) graded universal evaluators u^ B £ C n (PA,B) 
such that for every /„ £ C n (A, B) there is F £ 
Cq(X, P) such that 


B B 



A A 


(b) partial evaluators s' 4 £ Cg(PA, P) such that 


C 



P A B 


C 



P A B 


( 18 ) 


(c) trace evaluators t n £ C„(P, P) and 

output extractors \n b £ c\(P,B) such that 



4.3. Examples of graded monoidal computer 


First the bad news. Since graded monoidal com- 
puter extends the structure of monoidal computer, it 
seems natural that the standard model of monoidal 
computer, with a suitable grading, should provide a 
model of graded monoidal computer. However, the 
standard monoidal computer cannot be extended to a 
graded monoidal computer! The reason lies in Blum’s 
Speedup Theorem ©. Q. Blum’s constructed a com- 
putable function such that for every program that 
implements it there is another program that computes 
the same, but faster by an arbitrary recursive factor. 
The construction applies to an arbitrary Blum mea- 
sure (cf. Def. 16. It . The message is that complexity 
is not a property of computable functions, but of 
programs. Therefore, the category of computable func- 
tions, which provides the standard model of monoidal 
computer, is not a good place to measure complexity. 

The good news is that this is not a bug, but 
an important feature of the approach! The concept 
of graded monoidal computer, as a categorical ax- 
iomatization of computational complexity, uncovers 
the fact that the universe of computation should not 
be modeled as the category of computable func- 
tions, but the category of computations, viewed as 
the pairs (program, function that it implements). The 
realisation that this is the right categorical model 
echoes what Levin and Meyer called the ’’Fundamental 
Theorem of Complexity Theory ” lf23ll . Il25ll . which they 
formulated as a statement unifying Blum’s Speedup 
and Compression Theorems 0- The standard 
model of graded monoidal computer thus presents a 
computation as a pairs A ^' F - \ B, wher^D {F 1 } = /. 

1. Recall that Kleene’s bracket {— } is used in classical resursion 
theory to denote the universal evaluators. 


This is a monoidal computer, since for every compu- 

(f,F) 

tation A — : — > B, i.e. for every program F. there is 
a program <f> such that {'I'} = F and a morphism 
1 P, so that we can define 7 = 

({F},{<t>}) = (f,F). 

To define the grading, consider the set T of the ex- 
ecution traces like CD, and fix an encoding T > IN 

such that the parallel and the sequential compositions 
of the traces are associative and unitary. These require- 
ments mean that the program compositions, the data- 
passing and buffering operations (both modeled by the 
identity morphisms), and the input-output operations 
are all assigned grade 0. Define a total recursive 
function IN x N IN so that r / n ® r g n > r f;g~ l and 
r / n © r t~' > r f <8> f n . Fix the universal evaluators u, 
and define u^ B (F, a) to not just build the trace t(F, a), 
but at the same time computes the code r t(F, a) n E IN; 
and that it halts when r t(F, a) n > n. Let C n (A, B) 
consist of the computations (/, F) that ’’clock out” at 
n, i.e. u (F,a) = u n (F,a) for all a. 

While the details of the trace encodings and their 
use in the evaluations have to be deferred for the full 
paper, it should be clear that they amount to a routinely, 
albeit lengthy programming task, that awaits, e.g., the 
designer of a debugging tool that needs to capture, 
store, and play the internal execution traces. 

The nondeterministic and the quantum monoidal 
computers lift in a similar way, but lead to substantially 
different grading structures. 

5. Normal form 

Lemma 5.1: Every graded universal evaluator 
in a graded monoidal computer decomposes into the 
normal form s A ; t ra ; w ;i , or diagrammatically: 



Corollary 5.2: Every computation /,, : A — >■ B in 
a graded monoidal computer decomposes for each of 
its programs F into the normal form F : s ' ; t„, : w s 



A 


Remark For n = 00 , Corollary 15.21 is the monoidal 
version of Kleene’s Normal Form Theorem C2 or 
any textbook in recursion theory], Kleene proved his 
theorem by specifying a primitive recursive output 
extractor w B , and implementing too (s A (F,a)) in the 
form gx.T(F,a,x), where T is a primitive recur- 
sive predicate that verifies that x is the trace of the 
evaluation {F}(a) of the program F on the input a. 
Corollary 15. 2l iust spells out that the categorical axioms 
of graded monoidal computer suffice for Kleene’s 
decomposition. The point is that this decomposition, in 
a sense, displays the process of computation, encoded 
in the execution traces, as the grading of the trace 
evaluators t„ . This allows us to measure complexity. 

6. Complexity measures 
6.1. Internal grading 

Intuitively, a complexity measure is a computable 
function c that takes a program F and an input a, and 
measures how much of a computational resource is 
needed to evaluate F on a. Since the measurements 
will be derived from the grades, we now assume that 
the grading monoid A4 is representable in C. This 
means that there is an object IN in C such that each 
m E M. is just a basis point I IN, i.e. A4 = Cq(FI). 
The monoid structure of A4 is internalized as the 

ffi 0 H 

diagram IN ® IN —y IN pz I in Cg. It is easy to see 

OO 

that the ordering < of A4 is then also representable as 
an internal predicate IN ® IN -§4 2 in Cg. 

We further assume that the grading of the trace 
evaluators t„ E C„(P, P) is internalized in the sense 
that there is t E C(P <8> IN, P) such that 



The normalization now implies that the grading of 
the universal evaluators is similarly internalized. Note, 
however, that this does not imply that every sequence 
of computable functions (/„) E Y\ n<OC) Cn(A, B) 
comes from some / E C(A (g) IN, B). This would 
imply that a computable limit /oo E C(A,B) with 
(foo) jn= fn always exists, which is not the case, 
as many uncomputable functions have computable 
approximations Cl . Kolmogorov complexity provides 
the basic examples. 

6.2. From Blum measures to normal measures 

Definition 6.1: A Blum measure (or a step-counting 
function J6]) is a computation c* 4 E C(PA, IN) where 


T 

A 


.A 


(i) / ^4 P <g> A 
I P <8> A 

(ii) P g) A ® M — 


» M halts if and only if 

U AB 

- — > B halts 

PI <g> HI -5» 2 is decidable. 


While condition © says that the abstract complex- 
ity measures are closely related with the universal 
evaluators, condition dTT]» says that they are essentially 
different. The following definition attempts to capture 
that difference. 

Definition 6.2: A notion of complexity is a triple 
(k*,k*,©) where k* : P M : k* are halting 
function^] in C\, the predicate P <S> P 2 is in c\, 
and they together satisfy 



7. Summary 


2 



• • 


P A 



Definition 6.3: A normal complexity measure in a 
graded monoidal computer is a family of computations 
c' 2 * 4 e C{¥A, M) for all A in C for which there is a 
notion of complexity (k*, k*. ©) that normalizes it: 



Proposition 6.4: A normal complexity measure is a 
Blum measure where evaluating the complexity of a 
program is not substantially harder than evaluating the 
program itself. More precisely, there is \ G PI) 

and a program C for all c so that 


2. The standard terminology in recursion theory is ’’total recursive 
functions”. But in other parts of mathematics, a function is always 
total on its domain, unless we don’t know the domain, and it is 

specified that it is a partial. And moreover, a Turning machine may 

write some data on the output tape, and thus provide an output, 
without halting. So it seems necessary to specify that it is a halting 
function, and unnecessary to specify that it is total. 


Theoretical computer science works with a wide 
gamut of different models of computation. While they 
all implement the same family of computable func- 
tions, they also confront us with a wide gamut of 
different low-level machine languages that we use to 
describe computations. The fact that all these different 
machines compute the same functions through radi- 
cally different computational processes is usually cele- 
brated as a conceptual miracle, giving rise to Church’s 
Thesis. But the conceptual miracle gives way to the 
technical difficulties when it comes to programming 
in these machine languages. Proving that a feasible 
computation in one model will not become unfeasible 
in another model is generally not an easy task. With the 
questions that involve translating a complexity concept 
from one model to another often beyond reach, it 
seems fair to say that complexity theory is largely a 
mosaic of machine dependent concepts. The program- 
ming routines of hiding the implementation details 
and of high-level languages, on which the practice of 
computation has been based for more than 50 years, 
have not yet reached the theory of computation. 

A notable early effort towards machine independent 
complexity theory was initiated by Blum m, o, 
and pursued by others l25l . j23l . We implement and 
investigate some of their ideas in the framework of 
monoidal computer. Normal complexity measures, that 
admit a version of Kleene’s normal form, emerge as 
an interesting concept. There is a sense in which 
the space of normal complexity measures is spanned 
by the time and the space complexity measures, as 
an orthogonal basis. This will have to be elaborated 
in the future work, together with all the proofs and 
details omitted from this extended abstract. While the 
measures that are not normal provide important design 
time information about algorithms, and for theoretical 
analyses, normal measures can also be used at run 
time, as practical tools of computation, e.g. to set the 


bounds for hypothesis testing, inductive inference and 

algorithmic learning. 
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XA = IX A P XA 


U (XA)B 


y B 
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• 13.2lfbb and (|28| > give 


„,ab 

lx 



JXA)B \ 

> PJ 
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Proof sketch for Prop. 14.51 
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Appendix 

Proof sketch for Prop. I3l2l 

Given 7 as in Def. I3.1IHI1 >. the universal evaluators 
u are defined 

u AB = 7p S (idp) (26) 

and then the partial evaluators s are determined by 

l^A U AB)C ) = u {AB)C ( 27 ) 


